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(54) Method and apparatus for providing proxying and transcoding of documents in a distributed 
■network 

(57) A method of providing a document to a client 
coupled to a server is provided. The server provides a 
number ol Internet services to the client, Including func- 
tioning as a caching proxy on behalf of the client tor pur- 
poses of accessing the World Wide Web. The proxying 
server includes a persistent document database, which 
stores various attributes of all documents previously 
retrieved in response to a request from a client. When a 
Web document is retrieved from a remote server in 
response to a request from the client, the database is 
consulted and the stored information relating to the 
requested document is used by tha server In transcod- 
ing the document. The document is transccded for vari- 
ous purposes, including to circumvent bugs or quirks 
found In the document, to size the document tor display 
on a television set, to improve transmission efficiency of 
the document, and to reduce latency. The transcoder 
makes use of the document database to perform these 
functions. The document database Is also used tor 
prefetching previously requested documents and 
images and for reducing latency when downloading 
images to the client 
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1 EP0 811 

Description 

FIELD OF THE INVENTION 

The present invention pertains to the field of client- « 
server computer networking. More particularly, the 
present Invention relate? to a method and apparatus tor 
providing proxying and document transcoding in a 
server in a computer network. 

10 

BACKGROUND QF THE INVENTION 

The number of people using personal computers 
has Increased substantially In recent years, and along 
with this increase has come an explosion in the use of is 
the Internet. One particular aspect of the Internet which 
has gained widespread use is the World-Wide Web 
("the Web"). The Web is a collection of formatted hyper- 
text pages located on numerous computers around the 
world that are logically connected by the Internet so 
Advances in network technology and software providing 
user interfaces to the Web ("Web browsers*) have made 
the Web accessible to a targe segment of the popula- 
tion. However, despite the growth in the development 
and use of the Web, many people are still unable to take 25 
advantage of this Important resource. 

Access to the Web has been limited thus far mostly 
to people who have access to a personal computer. 
However, many people cannot afford the cost of even a 
relatively inexpensive personal computer, while others 30 
are either unable or unwilling to learn the basic compu- 
ter skills that are required to access the Web. Further* 
more, Web browsers in the prior art generally do not 
provide the degree of user-friendliness desired by some 
people, and many computer novices do not have the 33 
patience to learn how to use the software. Therefore, it 
would be desirable to provide an inexpensive means by 
which a person can access the Web without the use of 
a personal computer. In particular, H would be desirable 
for a person to be able to access the Web pages using 40 
an ordinary television set and a remote control, so thai 
the person feels more as if he or she is simply changing 
television channels, rather than utilizing a complex com- 
puter network 

Prior art Web technology also has other significant 49 
limitations which can make a person's experience 
unpleasant when browsing the Web. Web documents 
are commonly written in HTML (Hypertext Mark-up lan- 
guage). HTML documents sometimes contain bugs 
(errors) or have features that are not recognized by cer- so 
tain Web browsers. These bugs or quirks in a document 
can causa a Web browser to tall. Thus, what Is needed 
is a means for reducing the frequency with which client 
systems fail due to bugs or quirks in HTML documents. 

Another problem associated with browsing the Web 55 
is latency. People commonly experience long, frustrat- 
ing delays when browsing the Web. It is not unusual for 
a person to have to wait minutes after selecting a hyper- 
text link for a Web page to be completely downloaded to 
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his computer and displayed on his computer screen. 
There are many possible causes for latency, such as 
heavy communications traffic on the Internet and slow 
response of remote servers. Latency can also be 
caused by Web pages including images. One reason for 
this effect is that, when an HTML document references 
an image, it takes time to retrieve the image itseH after 
the referencing document has been retrieved. Another 
reason is that, in the prior art, if the referencing docu- 
ment does not epeclly the size of the Image, the client 
system generally cannot display the Web page until the 
image itself has been retrieved. Numerous others 
sources of latency exist wfth respect to the Wetx There- 
lore, what is needed is a means for reducing such 
latency, to eliminate some of the frustration which typi- 
cally has been associated with browsing the Web. 

Security is another concern associated with the 
Internet. Internet service providers (ISPs) generally 
maintain certain Information about each customer in a 
database. This information may include information 
which a customer may not wish to become publicly 
known, such as social security numbers and credit card 
numbers. Maintaining the confidentiality of this informa- 
tion in a system that is connected to an expensive pub- 
licly-accessible computer network like the Internet can 
be problematic. Further, the problem can be aggravated 
by the fact that an ISP often provides numerous different 
services, each of which has access to this database. 
Allowing access to the database by many different enti- 
ties creates many opportunities for security breaches 1o 
occur. Therefore, what is needed is a way to improve the 
security of confidential customer information in a server 
system coupled to the Internet. 

SUMMARY OF THE INVENTION 

A method is described of providing a document to a 
client coupled to a server. The server functions as a 
proxy on behalf of the client for purposes of accessing a 
remote server. In the method, a document Is retrieved 
from the remote server in response to a request from 
the client. The document includes data to be used by 
the diem In generating a display. The proxying server 
alters the data in the document to form a transcoded 
document. The transcoded document is then transmit- 
ted to the client 

Other features of the present invention will be 
apparent from the accompanying drawings and from the 
detailed description which follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of exam- 
ple and not limitation in the figures of the accompanying 
drawings, in which like references Indicate similar ele- 
ments and in which; 

Figure 1 illustrates several clients connected to a 
proxying server in a network. 
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3 EP0B11 

Figure 2 Illustrates a client according to the present 
invention. 

Figure 3 re a block diagram of a server according to 
the present Invention. 

Figure * A illustrates a server including a proxy 6 
cache and a transcoder. 

Figure 4B Illustrates databases used In a server 
according to the present invention. 
Figure 5 is a flow diagram illustrating a routine for 
transcoding a document retrieved from a remote w 
server using data stored in a persistent database, 
Figure 6 is a flow diagram illustrating a routine for 
transcoding an HTML document for purposes of 
eliminating bugs or undesirable features. 
Figure 7 is a flow diagram illustrating a routine for is 
reducing latency when downloading a document 
referencing an image to a client. 
Figure 8 is a flow diagram illustrating a routine for 
updating documents stored In the proxy cache 
using data stored in a persistent database. so 
Figure 9 is a flow diagram illustrating a routine used 
by a server for retrieving documents from another 
remote server. 

Figure 10 ie a block diagram of a prior art server 
system showing a relationship between various as 
services and a database. 

Figure 1 1 is a block diagram of a server system 
according to the present Invention showing a rela- 
tionship between various services and a user data- 
base, oo 
Figure 12 Is a flow diagram Illustrating a routine 
used by a server for regulating access to various 
services provided by the server. 

DETAILED DESCRIPTION 38 

A method and apparatus are described for provid- 
ing proxylng and transcoding of documents In a net- 
work. In the tallowing description, for purposes of 
explanation, numerous specific details are set forth In 40 
order to provide a thorough understanding of the 
present invention. It will be evident, however, to one 
skilled In the an that the present Invention may be prac- 
ticed without these specific details. In other instances, 
well-known structures and devices are shown in block 49 
diagram form in order to avoid unnecessarily obscuring 
the present invention. 

The present invention includes various steps, which 
will be described below. The steps can be embodied in 
machine-executable Instructions, which can be used to 60 
cause a general-purpose or special-purpose processor 
programmed with the Instructions to perform the steps. 
Alternatively, the steps of the present invention might be 
performed by specific hardware components that con- 
tain hardwired logic for performing the steps, or by any 55 
combination of programmed computer components and 
custom hardware components. 
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I. System Overview 

The present invention is included in a system, 
known as WebTV™, tor providing a user with access to 
the Internet A user of a WebTV™ client generally 
accesses a WebTV™ server via a direct-dial telephone 
(POTS, for "plain old telephone service"), ISDN (Inte- 
grated Services Digital Network), or other simitar con- 
nection, in order to browse the Web, send and receive 
electronic mail (e-mail), and use various other WebTV™ 
network services. The WebTV™ network services are 
provided by WebTV™ servers using software residing 
within the WebTV™ servers in conjunction with software 
residing within a WebTV™ client. 

Figure 1 illustrates a basic configuration of the 
WebTV™ network according to one embodiment. A 
number of WebTV* clients 1 are coupled to a modem 
pool 2 via direct-dial, bi-directional data connections 29, 
which may be telephone (POTS, i.e., "plain old tele- 
phone service"), ISDN (Integrated Services Digital Net- 
work), or any other simitar type of connection. The 
modem pool 2 is coupled typically through a router, 
such as that conventionally known in the art, to a 
number of remote servers 4 via a conventional network 
infrastructure 3, such as the Internet. The WebTV™ sys- 
tem also Includes a WebTV™ server 5, which specifi- 
cally supports the WebTV™ clients 1. The WebTV™ 
clients 1 each have a connection to the WebTV™ server 
5 either directly or through the modem pool 2 and the 
Internet 3. Note that the modem pool 2 is a conventional 
modem pool* such as those found today throughout the 
world providing access to the Internet and private net- 
works. 

Note that in this description, in order to facilitate 
explanation the WebTV™ server 5 is generally dis- 
cussed ae if it were a single device, and functions pro- 
vided by the WebTV™ services are generally discussed 
as being performed by such single device. However, the 
WebTV™ server 5 may actually comprise multiple phys- 
ical and logical devices connected In a dlstrbuted archi- 
tecture, and the various functions discussed below 
which are provided by the WebTV™ services may actu- 
ally be distributed among multiple WebTV* server 
devices. 

II. Client System 

Figure 2 illustrates a WebTV™ client 1. The 
WebTV™ client 1 includes an electronics unit 10 (here- 
inafter referred to as "the WebTV™ box 1 0") , an ordinary 
television set 12, and a remote control 1 1 . In an alterna- 
tive embodiment of the present Invention, tha WebTV™ 
box 10 is built into the television set 12 as an integral 
unit. The WebTV™ box 10 Includes hardware and soft- 
ware for providing the user with a graphical user Inter- 
face, by which the user can access the WebTV™ 
network services, browse the Web, send e-mail, and 
otherwise access the Internet. 

The WebTV™ client 1 uses the television set 12 as 
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a display device. The WebTV™ box 10 is coupled to the 
television set 12 by a video link 6. The video link 6 is an 
RF (radio frequency), 5-vldeo, composite video, or 
other equivalent form of video link. In the preferred 
embodiment, the client 1 includes both a standard 6 
modem and an ISDN modem, such that the communi- 
cation link 29 between the WebTV™ box 10 and the 
server 5 can be either a telephone (POTS) connection 
29a or an ISDN connection 29b, The WebTV™ box 10 
receives power through a power line 7. 

Remote control 1 1 is operated by the user in order 
to control the WebTV™ client 1 in browsing the Web, 
sending e-mail, and performing other Internet-related 
functions. The WebTV™ box 10 receives commands 
from remote control 11 via an infrared (IR) communica- 
tion link. In alternative embodiments, the link between 
the remote control 1 1 and the WebTV™ box 10 may be 
RF or any equivalent mode of transmission. 

III. Server System 

The WebTV™ server 5 generally includes one or 
more computer systems generally having the architec- 
ture illustrated in Figure 3. It should be noted that the 
illustrated architecture is only exemplary; the present 
Invention Is not constrained to this particular architec- 
ture. The illustrated architecture includes a central 
processing unit (CPU) 50, random access memory 
(RAM) 51. read-only memory (ROM) 52, a mass stor- 
age device 53, a modem 54, a network interface card 
(NIC) 55, and various other input/output (I/O) devices 
56. Mass storage device 53 includes a magnetic, opti- 
cal, or other equivalent storage medium. I/O devices 56 
may include any or all of devices such as a display mon- 
itor, keyboard, cursor control device, etc.. Modem 54 is 
used to communicate data to and Irom remote servers 
4 via the Internet. 

As noted above, the WebTV™ server 5 may actually 
comprise multiple physical and logical devices con- 
nected In a distributed architecture. Accordingly NIC 55 
is used to provide data communication with other 
devices that are part of the WebTV™ services. Modem 
54 may also be used to communicate with other devices 
that are part of the WebTV™ services and which are not 
located in close geographic proximity to the illustrated 
device. 

According to the present invention, the WebTV™ 
server 5 acte as a proxy in providing the WebTV™ client 
1 with access to the Web and other WebTV™ services. 
More specifically, WebTV™ server 5 functions as a 
"caching proxy". Figure 4A illustrates the caching fea- 
ture of the WebTV™ 6erver 5. In Figure 4A, the 
WebTV™ server 5 is functionally located between the 
WebTV™ client 1 and the Internet infrastructure 3. The 
WebTV™ server 5 includes a proxy cache 65 which is 
functionally coupled to the WebTV™ client 1. The proxy 
cache 65 is used tor temporary storage of Web docu- 
ments, images, and other information which is used by 
frequently either the WebTV™ client 1 or the WebTV™ 



server 5. 

A document transcoder 66 Is functionally coupled 
between the proxy cache 65 and the Internet infrastruc- 
ture 3. The document transcoder 66 Includes software 
which is used to automatically revise the code of Web 
documents retrieved from the remote servers 4, for pur- 
poses which are described below. 

The WebTV™ service provides a document data- 
base 61 and a user database 62, as illustrated in Figure 
4B. The user database 62 contains information that is 
used to control certain features relating to access privi- 
leges and capabilities of the user of the client 1. This 
information is used to regulate initial access to the 
WebTV™ service, as well as to regulate access to the 
individual services provided by the WebTV™ system, ae 
will be described below. The document database 61 Is a 
persistent database which stores certain diagnostic and 
historical Information about each document and image 
retrieved by the server 5, as is now described. 

A. Document Database 

The basic purpose of the document database 61 is 
that, after a document has once been retrieved by the 
server 5, the stored information can be used by the 
server 5 to speed up processing and downloading of 
that document in response to all future requests for that 
document. In addition, the transcoding functions and 
various other functions of the WebTV™ service are facil- 
itated by making use of the information stored in the 
document database 61, as will be described below. 

Referring now to Figure 5, the server 5 initially 
receives a document request from a client 1 (step 501). 
The document request will generally result from the 
user of the client 1 activating a hypertext anchor (link) 
on a Web page. The act of activating a hypertext anchor 
may consist of clicking on underlined text in a displayed 
Web page using a mouses for example. The document 
request will typically (but not always) include the URL 
(Uniform Resource Locator) or other address of the 
selected anchor. Upon receiving the document request, 
the server 5 optionally accesses the document data- 
base 62 to retrieve stored Information relating to the 
requested document (step 502). h should be noted that 
the document database 62 is not necessarily accessed 
in every case. The information retrieved from the docu- 
ment database 62 is used by the server 5 lor determin- 
ing, among other things, how long a requested 
document has been cached and/or whether the docu- 
ment Is still valid, The criteria for determining validity of 
the stored document are discussed below. 

The server 5 retrieves the document from the cache 
65 if the stored document is valid; otherwise, the server 
5 retrieves the document from the appropriate remote 
server 4 (step 503). The server 5 automatically trans- 
codes the document as necessary based on the infor- 
mation stored in the document database 61 (step 503). 
The transcoding functions are discussed further below. 

The document database 61 includes certain histor- 
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leal and diagnostic Information for every Web page that 
is accessed at any time by a WebTV™ client 1 . As is well 
known, a Web page may correspond to a document 
written in a language such as HTML (Hypertext Mark- 
Up Language), VRML (Virtual Reality Modelling Lan- 6 
guage). or another suitable language. Alternatively, a 
Web page may represent an image, or a document 
which references one or more images. According to the 
present invention, once a document or image is 
retrieved by the WebTV™ server 5 from a remote server w 
4 for the first time, detailed information on this document 
or image is stored permanently in the document data- 
base 61. More specifically, for every Web page that Is 
retrieved from a remote server 4, any or all of the follow- 
ing data are stored In the document database 61 : 75 

1) information identifying bugs (errors) or quirks in 
the Web page, or undesirable effects caused when 
the Web page is displayed by a client 1 ; 

2) relevant bug-finding algorithms; so 

3) the date and time the Web page was last 
retrieved; 

4) the dale and time the Web page was most 
recently altered by the author; 

5) a checksum for determining whether the Web as 
page has been altered; 

6} the size of the Web page (in terms of memory); 
7) the type of Web page (e.g., HTML document, 
image, etc ); 

6) a list of hypertext anchors (li nks) in the Web page 00 
and corresponding URLs; 

9) a list of the most popular anchors based on the 
number of "hits" (requests from a client 1]; 

10) a list of related Web pages which can be 
prefetched *b 

11) whether the Web page has been redirected to 
another remote server 4; 

12) a redirect address (If appropriate); 

1 3) whether the redirect (if any) is temporary or per- 
manent, and II permanent, the duration of tha racfl- 40 
red; 

14) il the Web page is an image, the size of the 
Image In terms of both physical dimensions and 
memory space; 

1 5) the sizes of in-line images (images displayed in « 
text) referenced by the document defining the Web 
page; 

16) the size of the largest image referenced by the 
document; 

1 7) Information identifying any Image maps In the eo 
Web page; 

18) whether to resize any Images corresponding to 
the Web page; 

19) an indication of any forms or tables in the Web 
page; 55 

20) any unknown protocols; 

21) any links to "dead" Web pages (i.e., pages 
which are no longer active): 

22) the latency and throughput of the remote server 
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4 on which the Web page Is located; 

23) the character set of the document; 

24) the vendor of the remote server 4 on which the 
Web page Is located; 

25) the geographic location of the remote server 4 
on which the Web page is located; 

26) the number of other Web pages which refer- 
ence the subject Web page; 

27) the compression algorithm used by the image 
or document; 

28) the compression algorithm chosen by the trans- 
coder; 

29) a value indicating the popularity of the Web 
page based on the number of hits by clients; and 

30) a value indicating the popularity of other Web 
pages which reference tha subject Web page. 

B. Transcoding 

As mentioned above, the WebTV™ cervices pro- 
vide a transcoder 68, which is used to rewrite certain 
portions of the code in an HTML document for various 
purposes, These purposes include: (1) correcting bugs 
in documents; (2) correcting undesirable effects which 
occur when a document is displayed by the client 1 ; (3) 
Improving the efficiency of transmission of documents 
from the server 5 to the client 1 ; (4) matching hardware 
decompression technology within the client 1 ; (5) resiz- 
ing images to fit on the television set 12; (6) converting 
documents into other formats to provide compatibility; 
(7) reducing latency experienced by a client 1 when dis- 
playing a Web page with in-line images (images dis- 
played in text); and, (8) altering documents to fit into 
smaller memory spaces. 

There are three transcoding modes used by the 
transcoder 66: (1) streaming, (2) buffered, and (3) 
deferred. Streaming transcoding refers to the transcod- 
ing of documents on a llne-by-llne basis as they are 
retrieved from a remote server 4 and downloaded to the 
client 1 (I.e., transcoding "on the fly"). Soma documents, 
however, must first be buffered in the WebTV™ server 5 
before transcoding and downloading them to the client 
1 . A document may need to be buffered before transmit- 
ting rt to the client 1 if the type of changes to be made 
can only be made after the entire document has been 
retrieved from the remote server 4. BecausB the proc- 
ess of retrieving and downloading a document to the cli- 
ent 1 increases latency and decreases throughput, it is 
not desirable to buffer all documents. Therefore, the 
transcoder 66 accesses and uses Information In the 
document database 61 relating to the requested docu- 
ment to first determine whether a requested document 
must be buffered for purposes of transcoding, before 
the document Is retrieved from the remote server 4. 

In the deterred mode, transcoding Is deferred until 
after a requested document has been downloaded to a 
client 1. The deferred mode therefore reduces latency 
experienced by the client 1 in receiving the document. 
Transcoding may be performed immediately after down- 
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loading or an/ time thereafter. For example, It may be 
convenient to perform transcoding during periods of low 
usage of WebTV™ 1 services, such as at night This 
mode is useful for certain types of transcoding which 
are not mandatory. 

1. "Transcoding for Bugs and Quirks 

One characteristic of some prior art Web browsers 
is that they may experience failures ("crashes") because 
of bugs or unexpected features ("quirks") that are 
present in a Web document. Alternatively, quirks in a 
document may cause an undesirable result even 
though the client does not crash. Therefore, the trans- 
coding feature of the present invention provides a 
meane tor correcting certain bugs and quirks In a Web 
document To be corrected by the transcoder 66, bugs 
and quirks must be identifiable by software running on 
the server 5. Consequently, the transcoder 66 will gen- 
erally only correct conditions which have been previ- 
ously discovered, such as those discovered during 
testing or reported by users. Once a bug or quirk is dis- 
covered, however, algorithms are added to the trans- 
coder 66 to both detect the bug or quirk in the future in 
any Web document and to automatically correct it. 

There are countless possibilities of bugs or quirks 
which might be encountered in a Web document 
Therefore, no attempt will be made herein to provide en 
exhaustive list Nonetheless, some examples may be 
useful at this point Consider, for example, an HTML 
document that is downloaded from a remote server 4 
and which contains a table having a width specified in 
the document as "0." This condition might cause a fail- 
ure if the client were to attempt to display the document 
as written. This situation therefore, can be detected and 
corrected by the transcoder 66. Another example is a 
quirk in the document which causes quotations to be 
terminated with too many quotation marks. Once the 
quirk is first detected and an algorithm Is written to rec- 
ognl2fl H, the transcoder 86 can automatically correct 
the quirk in any document. 

If a given Web document has previously been 
retrieved by the server 5, there will be Information 
regarding that document available in the document 
database 61 as described above, The information 
regarding this document will include whether or not the 
document included any bugs or quirks that required 
transcoding when the document was previously 
retrieved. The transcoder 66 utilizes this information to 
determine whether (1) the document Is free of bugs and 
quirks, (2) the document has bugs or quirks which can 
be remedied by transcoding on the fly, or (3) the docu- 
ment has bugs or quirks which cannot be corrected on 
the fly (i.e., buffering is required). 

Figure 6 Illustrates a routine for transcoding a Web 
document for purposes of eliminating bugs and quirks. 
Initially, the server 5 receives a document request from 
the client 1 (step 601). Next, the document database 61 
is accessed to determine whether or not the requested 
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document has been previously retrieved (step 602). If 
the document has not been previously retrieved, then 
the server 6 retrieves the document from the remote 
server 4 (step 609). Next, the retrieved document is 

s analyzed for the presence of bugs or unusual conditions 
(step 610). Various diagnostic information is then stored 
in the document database 61 as a result of the analysis 
to note any bugs or quirks that were found (step 6 1 1 ). If 
any bugs or quirks were found which can be corrected 

w by the transcoder 66, the document Is then transcoded 
and saved to the proxy cache 65 (step 612). The trans- 
coded document is then downloaded to the client 1 
(step 613). It should be noted that transcoding can be 
deferred until after the document has been downloaded, 

is as described above; hence, the sequence of Figure 6 Is 
illustrative only 

If (in step 602) the requested document had been 
previously retrieved, then it is determined whether the 
requested document is still valid (step 603) and whether 

20 the document is present in the proxy cache 65 (step 
604). If the document is no longer valid, then the docu- 
ment is retrieved from the remote server 4, analyzed for 
bugs and quirks, transcoded as required, and then 
downloaded to the client 1 as described above (steps 

£5 610-613, step 607). Methods for determining validity of 
a document are discussed below. If the document Is still 
valid (step 603) and the document is present in the 
cache 65, the document Is downloaded to the client 1 In 
hs current form (as H is stored in the cache), since H has 

30 already been transcoded (step 608). 

The document, however, may be valid but not 
present in the cache. This may be the case, for exam- 
ple, if the document has not been requested recently 
and the cache 65 has become too full to retain the 

35 requested document. In that case, the document is 
retrieved again from the remote server 4 (step 605) and 
then transcoded on the basis of the previously-acquired 
diagnostic Information stored within the database 61 for 
that document. The document Is then saved to the 

40 cache 65 (step 60S). Note that because the document Is 
still valid, It is assumed that the diagnostic information 
stored in the document database 61 for that document 
Is still valid and that the transcoding can be performed 
on the basis of that information. Accordingly, once the 

4e document is transcoded, the transcoded document is 
downloaded to the client 1 (step 607). Again, note that 
transcoding can be deferred until after the document 
has been downloaded in some cases. 

The validity of the requested document can be 

60 determined based on various different criteria. For 
example, some HTML documents specify a date on 
which the document was created, a length of time for 
which the document will be valid, or both. The validity 
determination can be based upon such information. For 

55 example, a document which specifies only the date of 
creation can be automatically deemed invalid after a 
predetermined period of time ha6 passed. 

After natively, validity can be based upon the popu- 
larity of the requested document. "Popularity" can be 
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quantified based upon the number of hits for that docu- 
ment, which is tracked in the document database 61 . 
For example, It might be prudent to simply assign a rel- 
atively short period of validity to a document which is 
very popular and a longer period of validity to a docu- & 
ment which is less popular. 

Another alternative baste tor the validity of a docu- 
ment is the observed rate of change of the document. 
Again, data in the persistent document database 61 can 
be used. That is, because the document database 61 10 
stores the date and time on which the document was 
last observed to change, the server 5 can approximate 
how often the document actually changes. A document 
or Image which Is observed to change frequently (e.g., 
a weather map or a news page) can be assigned a rel- is 
atlvely short period of validity. It will be recognized that 
numerous other ways of determining validity are possi- 
ble. 



2. Transcoding to Reduce Latency 



so 



Another purpose for transcoding is to allow docu- 
ments requested by a client 1 to be displayed by the cli- 
ent 1 more rapidly. Many HTML documents contain 
references to "in-line" images, or images that will be dis- as 
played In text In a Web page. The normal process used 
in the prior art to display a Web page having in-line 
Images Is that the HTML document referencing the 
image is first downloaded to the client, followed by the 
client's requesting the referenced image. The refer- $o 
enced image is then retrieved from the remote server on 
which it is located and downloaded to the client. One 
problem associated with the prior art, however, is that 
the speed with which a complete Web page can be dis- 
played to the user is often limited by the time it takes to 
retrieve in-line images. One reason for this is that it sim- 
ply takes lime to retrieve the image itself after the refer- 
encing document has been retrieved. Another reason Is 
that, in the prior art if the referencing document does 
not specify the size of the Image, tha Web page goner- 40 
ally cannot be displayed until the image itself has been 
retrieved. The present invention overcomes these limi- 
tations. 

According to the present invention, information 
stored in the document database 61 regarding the in- 49 
line images is used to transcode the referencing docu- 
ment in order to reduce latency in displaying the Web 
page. Once any document which references an in-line 
image is initially retrieved by tha server 5, the fact that 
the document references an In-line Image Is stored In so 
the document database 61. In addition, the eke of the 
Image Is determined, either from the document (If spec- 
ified) or from the image itself, and then stored in the 
document database 61 . Consequently, for documents 
which do not specify the size of their In-line images, the ss 
size information stored in the database 61 is then used 
the next time the document is requested in order to 
reduce latency in downloading and displaying the Web 
page. 



Refer now to Figure 7, which Illustrates a routine for 
reducing latency when downloading a document refer- 
encing an Image to a client 1. Assume that a client 1 
sends a request to the server 5 for an HTML document 
containing a reference to an in-line image. Assume fur- 
ther that the size of the image is not specified in the doc- 
ument itself. Initially, the server 5 determines whether 
that document has been previously retrieved (step 701). 
tf not, the standard initial retrieval and transcoding pro- 
cedure Is followed (step 706), as described In connec- 
tion with Figure 6. If, however, the document has been 
previously retrieved, then the transcoder 66 accesses 
the size Information stored In the document database 
61 for the in-line image (step 702). Based on this size 
Information, tfie HTML document Is transcoded such 
that, when the Web page is initially displayed by the cli- 
ent 1, the area in which the image belongs Is replaced 
by a blank region enveloping the shape of the image. 
Thus, any in-line image referenced by a document is 
displayed initially as a blank region. Consequently, the 
client 1 can immediately display the Web page corre- 
sponding to the HTML document even before the refer- 
enced image has been retrieved or downloaded (i.e., 
even before the size of the image is known to the client 
1). 

As the transcoded HTML document Is downloaded 
lo the client, the image is retrieved from the appropriate 
remote server 4 (step 704). Once the Image Is retrieved 
from the remote server 4 and downloaded to the client 
1 , the client 1 replaces the blank area in the Web page 
with the actual image (step 705). 

3. Transcoding to Display Web Pages on a Television 

As noted above, the client 1 utilizes an ordinary tel- 
evision eat 12 as a display device. However, images in 
Web pages are generally formatted for display on a 
computer monitor, not a television set. Consequently, 
the transcoding function of the present invention is used 
to resize Images for display on the television set 1 2. This 
includes r ©scaling images as necessary to avoid trunca- 
tion when displayed on the television set 12. 

it should be noted that prior an Web browsers 
which operate on computer monitors typically use resiz- 
able windows. Hence, the size of the visible region var- 
ies from client to client. However, because the web 
browser used by the WebTV™ client 1 is specifically 
designed for display on a television set the present 
invention allows documents and images to be formatted 
when they are cached. 

4. Transcoding for Transmission Efficiency 

Documents retrieved by the server 5 are also trans- 
coded to improve transmission efficiency In particular, 
documents can be transcoded in order to reduce high 
frequency components in order to reduce interlace 
flicker when they are displayed on a television set. 

Documents can also be transcoded in order to 
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lower the resolution of the displayed Web page. Reduc- 
ing ths resolution is desirable, because images format- 
ted for computer systems will generally have a higher 
resolution than the NTSC (National Television Stand- 
ards Committee) video format used by conventional tel- 6 
evision sets. Since the NTSC video does not have the 
bandwidth to reproduce the resolution of computer-for- 
matted images, the bandwidth consumed in transmitting 
images to the client 1 at such a high resolution would be 
wasted. to 

5. Other Uses lor Transcoding 

Transcoding la also used by the present Invention to 
recede a document using new formate into older, com- is 
patlble formats. Images are often displayed In the JPEG 
(Joint Picture Experts Group) format or the OIF image 
formal J PEG often consumes less bandwidth than GIF, 
however. Consequently, Images which are retrieved In 
GIF format are sometimes transcoded into JPEG for- so 
mat. Methods for generally converting images between 
GIF and JPEG formats are well known. 

Other uses for transcoding include transcoding 
audio files. For example, audio may be transcoded into 
different formats in order to achieve a desired balance 25 
between memory usage, sound quality, and data trans- 
fer rate. In addition, audio may be transcoded from a file 
format (e.g., an ".AU" file) to a streaming format (e.g., 
MPEG 1 audio). Yet another use of audio transcoding is 
the transcoding of MIDI (Musical Instrument Digital 30 
interface) data to streaming variants of MIDI. 

Additionally, documents or images requiring a large 
amount of memory (e.g., long lists) can be transcoded 
in order to consume less memory space in the client 1 . 
This may involve, for example, separating a large docu- m 
ment or image into multiple sections. For example, the 
server 5 can insert tags at appropriate locations in the 
original document so that the document appears to the 
client 1 as multiple Web pages. Hence, while viewing a 
given paga representing a portion of the original docu- 40 
ment, the user can view the next page (i.e., ihe next por- 
tion of the original document) by activating a button on 
the screen as If It were an ordinary hypertext anchor. 

C. Proxying 

As noted above, the server 5 functions as a proxy 
on behalf of the client 1 for purposes of accessing the 
Web. The document database 61 is used in various 
ways to facilitate this proxy role, as will now be so 
described. 

1. Updating Cached Documents 

it is desirable to store frequently-requested html ss 
documents and images in the proxy cache 65 to further 
reduce latency in providing Web pages to the client 1. 
However, because some documents and images 
change over time, documents in the cache 65 will not be 



valid Indefinitely, as mentioned above. A weather map 
or a news-related Web page, for example, are likely to 
be updated quite frequently Consequently, It ts desira- 
ble for the server 5 to have the ability to estimate the fre- 
quency with which documents change, in order to 
determine how long a document can safely remain 
within the proxy cache 65 without being updated. 

The persistent database 65 is used to store the 
date and time of the last several fetches of each docu- 
ment and image retrieved from a remote server 4, along 
with an indication of any changes that were detected, if 
any. A document or image which has been stored in the 
cache 65 is then retrieved on a periodic basis to deter- 
mine If It has been changed. Change status Information 
indicating whether the document has changed since the 
previous fetch Is then stored In the document database 
65. If no changes are detected, then the time Interval 
between fetches of this document is increased. If the 
document has changed, the time Interval is maintained 
or decreased. As a result, items in the cache 65 which 
change frequently will be automatically updated at fre- 
quent intervals, whereas documents which do not 
change often will be replaced in the cache less fre- 
quently. 

Figure 8 illustrates a routine for updating docu- 
ments stored In the proxy cache 65 using data stored In 
the document database 61 . Assume a document X has 
bean stored In the proxy cache 65. Document X 
remains in the cache 65 until a predetermined update 
period Tj expires (step 801). Upon the expiration of the 
update period T 1p the document x is again retrieved 
from the appropriate remote server 4 (step 802). The 
newly-retrieved document X is then compared to the 
cached version of document X (step 803). If the docu- 
ment has changed, then the cached version of docu- 
ment X is replaced with the newly-retrieved version of 
document X (step 806). If not, then the update period Tj 
Is Increased according to a predetermined time incre- 
ment At, (step 804). In any case, the date and time and 
the change status of document X Is saved to the docu- 
ment database 61 (step 805). 

Document and Image Prefetching 

The document database 61 is also used by the 
server 5 to store prefetching information relating to doc- 
uments end images. In particular, the database stores, 
for each document that has been retrieved, a list of 
images referenced by the document, if any, and their 
locations. Consequently, the next time a document Is 
requested by a client 1 , the images can be immediately 
retrieved by the server 5 (from In a cache 65, If available, 
or from the remote server 4), even before the client 1 
requests them. This procedure improves the speed with 
which requested Web pages are downloaded to the cli- 
ent. 

The document database 61 is elso used to facilitate 
a process referred to as "server-advised client prefetch- 
ing." Server-advised client prefetching allows the server 
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5 to Inform the client 1 of documents or Images which 
are popular to allow the client 1 to perform the prefetch- 
ing. In particular, for any given document a list Is main- 
tained in the server 5 of the most popular hypertext 
anchors in that document (i.e., those which have prevh s 
ously received a targe number of hits). When that docu- 
ment is requested by the client 1, the server 5 provides 
the client 1 with an indication of these popular links. 

3. Redirects 10 

Web pages are sometimes forwarded from the 
remote server on which they are initially placed to a dif- 
ferent location. Under the HTTP (Hypertext Transport 
Protocol), such forwarding is sometimes referred to as a is 
"redirect." When an HTML document Ig Initially stored 
on one remote server and then later transferred to 
another remote server, the first remote server will pro- 
vide, In response to a request for that document an 
indication that the document has been transferred to a so 
new remote server. This indication generally includes a 
forwarding address ("redirect address"), which is gener- 
ally a URL 

In the prior art, when a computer requesting a Web 
page receives a redirect, it must then submit a new is 
request to the redirect address. Having to submit a sec- 
ond request and wait for a second response consumes 
time and Increases overall latency. Consequently, the 
present Invention uses the document database 61 to 
store any redirect address for each document or image. 00 
Anytime a redirected document le requested, the server 
5 automatically accesses the redirect address to 
retrieve the document. The document or image is pro- 
vided to the client 1 based on only a single request from 
the client 1. The change in location of the redirected m 
document or image remains completely transparent to 
the client 1 . 

Figure 9 Illustrates a routine performed by the 
server 5 In accessing documents which may have been 
forwarded to a new remote server. Initially, the server 5 40 
receives a request for a document, which generally 
includes an address [step 901). The server 5 then 
accesses the document database 65 to determine 
whether there is a redirect address for the requested 
document (step 902). If there is no redirect address, 4* 
then the server 5 accesses a remote server 4 based on 
the address provided in the document request from the 
client 1 (stsp 903). Assuming that the remote server 4 
does not respond to the server 5 with a redirect (step 
904), the document Is retrieved and downloaded to the so 
client 1 by the server 5 (step 907). If, however, a redirect 
address was stored In the document database 65 (6tep 
902), then the server 5 accesses the requested docu- 
ment according to the redirect address (step 906). Or, if 
the remote server 4 responded with a redirect (step ss 
904), then the server 5 saves the redirect address to the 
document database 61 (step 905) and accesses the 
requested document according to the redirect address 
(step 906). 
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4. Other Proxy Functions 

The document database 65 also stores information 
relating to the performance of each remote server 4 
from which a document is retrieved. This information 
includes the latency and throughput of the remote 
server 4. Such Information can be valuable In Instances 
where a remote server 4 has a history of responding 
slowly. For example, when the document is requested, 
this knowledge can be used by the server 5 to provide a 
predefined signal to the client 1 . The client 1 can, in 
response to the signal, indicate to the user that a delay 
is likely and give the user the option of canceling the 
request. 

5. Backoff Mods 

Although the server 5 generally operates in the 
proxy mode, It can also enter a "backoff mode" In which 
the server 5 does not act as a proxy, or the server 5 per- 
forms only certain aspects of the normal proocying func- 
tions. For example, if the proxy cache 65 is overloaded, 
then the server 5 can enter a backoff mode in which 
documents are not cached but are tranecoded ae 
required. Alternatively, during times when the server 5 is 
severely overloaded with network traffic, the server 5 
may instruct the client 1 to bypass the server 5 and con- 
tact remote servers 4 directly for a specified time or until 
further notice. Or, the server 5 can enter a flexible back- 
off mode in which the client 1 will be instructed to con- 
tact a remote server 4 directly only tor certain Web sites 
for a limited period of time. 

D. Access to WebTV™ Services 

The WebTV™ server 5 provides various earvices to 
the client 1, such as proxying and electronic mail fe- 
malT). In the prior art, certain difficulties are associated 
with allowing a client computer access to different serv- 
ices of an Internet service, as will now ba explained with 
reference to Figure 10. 

Figure 10 illustrates a client-server system accord- 
ing to one prior art embodiment The server 76 provides 
various services A. B, and C. The server 76 includes a 
database 71 for storing information on the user's access 
privileges to services A, B, and C, The client 75 of the 
embodiment of Figure 1 0 accesses any of services A, 
B, and C by contacting that service directly. The con- 
tacted service then accesses the database 71 , which 
stores the access privileges of the client 75, to deter- 
mine whether the client 75 should be allowed to access 
that service. Hence, each service provided by the 
server 76 requires direct access to the database 71. 
This architecture results in a large number of accesses 
being made to the database 71 , which is undesirable, in 
addition, the fact that each service independently has 
access to the database 71 raises security concerns. 
Specifically, it can be difficult to isolate sensitive user 
information. The present invention overcomes such dit- 
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flcuttles using a technique which ts now described. 
1. Tickets Containing Privileges And Capabilities 

Ae shown En Figure 11, the server 5 provides a £ 
number of services D. E, and F, and a log-In service 78. 
The log-In service Is used specifically to control Initial 
log-on procedures by a client 1. The log-in service 78 
has exclusive access to the user database 62 (dis- 
cussed above with respect to Figure 4B). The log-in 
service 78 and the user database 82 are located within 
a first security zone 84. Service D is located within a 
second security zone 88, while services E and F are 
contained within a third security zone 88. Note that the 
specific arrangement of security zones 84, 88, and 88 
with respect to services D, E, and F Is Illustrative only, 

The user database 66 of the present invention 
stores various information pertaining to each authorized 
user of a client 1. This information includes account 
information, a list of the WebTV™ that services are 
available to the particular user, and certain user prefer- 
ences. For example, a particular user may not wish his 
client 1 to be used to access Web pages having adult- 
oriented subject matter. Consequently, the user would 
request that his account be filtered to prevent access to 
such material. This request would then be stored as 
part of the user data in the user database 66. 

With regard to user pref srences, the hypertext links 
selected by a given user can be tracked, and those hav- 
ing the largest number can be stored in the user data- 
base 66. The list can then be provided to the client 1 for 
use in generating a menu screen of the user's favorite 
Web sites, to allow the user to directly access those 
Web sites. The list can also be used by the server 5 to 
analyze the user's interests and to formulate and pro- 
vide to the user a list of new Web eites which the user ie 
likely to be interested in. The list might be composed by 
associated key words In Web pages selected by the 
user with other Web pages. 

Referring again to Figure 11 , In response to a log- 
on request by a client 1, the log-in service 78 consults 
the user database 82 to determine if access to the 
server 5 by this particular client 1 is authorized. Assum- 
ing access is authorized, the log-in service 78 retrieves 
certain user information pertaining to this particular cli- 
ent 1 from the user database 62. The log-in service then 
generates a Ticket" 82, which is an information packet 
including the retrieved information. The ticket 82 is then 
provided to the client 1 which requested access. 

The ticket 82 Includes all Information necessary to 
describe the access privileges of a particular user with 
respect to all services provided by the server 5. For 
example, the ticket may include the user name regis- 
tered to the client 1. the e-mail address assigned to cli- 
ent 1, and any tittering requested by the user with 
respect to viewing Web sites. Each time the user 
requests access to one of the services D, E, or F, the cli- 
ent 1 submits a copy of the ticket 82 to that service. The 
requested service can then determine from the copy of 
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the ticket 82 whether access to that service by that cli- 
ent 1 is authorized and, H so, any important information 
relating to such access. 

None of the services provided by the server 5, other 
than the log-in service 78, has access to the user data- 
base 62. Hence, any security-sensitive information can 
be Isolated within the user database 62 and the log-In 
service 78. Such isolation allows the individual services 
provided by the server 5 to be placed within separate 
"firewalls" (security regions), illustrated as security 
zones 84, 86, and 88. In addition, this technique greatly 
reduces the number of accesses required to the user 
database 62 compared to the prior art embodiment 
Illustrated In Figure 10. 

2. Redundancy of Services and Load Balancing 

The present invention also includes certain redun- 
dancies In the various services provided by the server 5. 
In particular, a given service (e.g.. e-mail) can be pro- 
vided by more than one physical or logical device. Each 
such device is considered a "provider" of that service. If 
a given provider is overloaded, or if the client 1 is unable 
to contact that provider, the client 1 can contact any of 
the other providers of that service. When the server 5 
receives a log-In request from a client 1, In addition to 
generating the above-described ticket 82, the log-in 
service 78 dynamically generates a list of available 
WebTV™ services and provides this list to the client 1 . 

The server 5 can update the list of services used by 
any client 1 to reflect services becoming unavailable or 
services coming on-line. Also, the list of services pro- 
vided to each client 1 can be updated by the server 5 
based upon changes in the loading of the server 5. in 
order to optimize traffic on the server 5. In addition, a cli- 
ent's list of services can be updated by services other 
than the log-in service 78, such that one service can 
effectively Introduce another service to the client 1 . For 
example, the e-mail service may provide a client 1 with 
the name, port number and IP of Its address book serv- 
ice. Thus, one service can effectively, and securely 
within the same chain of trust, introduce another service 
to the client 1. 

This list of services includes the name of each serv- 
ice, a port number tor the provider of each service, and 
an IP (Internet Protocol) for each service. Different pro- 
viders of the same service are designated by the same 
name, but different port numbers and/or IPs. Note that 
in a standard URL, the protocol is normally specified at 
the beginning of the URL, such as "HTTP:Mvww.... ,, 
under the HTTP protocol. However, according to the 
present Invention, the normal protocol designation (I.e., 
"HTTP") in the URL is replaced with the name of the 
service, since the port number and IP for each service 
are known to the client 2. Hence, the client 1 can access 
any of the redundant providers of a given service using 
the same URL. This procedure effectively adds a level 
of indirection to all accesses made to any WebTV™ 
service and automatically adds redundancy to the proxy 
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service. It should also be noted that separate service 
names can also rarer to the same service. 

Assume, for example, that the e-mail service pro- 
vided by the WebTV™ system Ig designated by the serv- 
ice name "WTV-mailto " A client 1 can access any s 
provider ol this e-mail service using the same URL. The 
client 1 merely chooses the appropriate port number 
and IP number to distinguish between providers. If the 
client 1 is unable to connect to one e-mail provider, it 
can simply contact the next one in the list. w 

Thus, at log-in time, a client 1 is provided with both 
a ticket containing privileges and capabilities as well as 
a list of service providers, as illustrated in Figure 12. Ini- 
tially, the log-In service 78 determines whether the user 
of client 1 is a valid user (step 1201). tf not log-in is is 
denied (step 1205). tf the user Is a valid user, then the 
log-in service 73 gathers user information from the user 
database 62 and generates a ticket 82 (step 1202). The 
log-In service 76 also generates the above-described 
list of services (step 1203). The ticket 82 and the list of » 
services are then downloaded to the client 1 (step 
1204). 

3. Asynchronous Notification to Clients by Server 

26 

Another limitation associated with prior art Internet 
servers is the inability to provide asynchronous notifica- 
tion Information to the client In the absence of a request 
from the client to do so. It would be desirable, for exam- 
ple, for a server to notify a client on its own initiative $o 
when a particular Web page has changed or that a par- 
ticular service is inaccessible. The server 5 of the 
present invention provides such capability, and the cli- 
ent 1 is configured to receive and decode such notifica- 
tions. For example, the client 1 can receive updates of *0 
its listing of service providers from the server 5 at vari- 
ous points in time, as already described. Similarly, H a 
particular service provider becomes unavailable, that 
fact will be automatically communicated to the client 1. 
As another example, tt a-mall addressed to the user has 40 
been received by the server 5, then the server 5 will 
send a message to the client 1 indicating this fact. The 
diem i win then notify the user that e-mail is waiting by 
a message displayed on the television set 12 or by an 
LED (light emitting diode) built into the housing of 40 
WebTV™ box 10. 

Thus, a method and apparatus have been 
described for providing proxying and transcoding of 
documents in a network Although the present invention 
has been described with reference to specific exam- eo 
plary embodiments, it will be evident that various modi- 
fications and changes may be made to these 
embodiments without departing Irom the broader spirit 
and scope of the invention as set forth in the daims. 
Accordingly, the specification and drawings are to be 55 
regarded in an illustrative rather than a restrictive sense. 
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Claims 

1. In a proxying server coupled to a client and to a 
remote server, the proxying server operating as a 
proxy on behalf of the client for accessing the 
remote server, a method of providing a first docu- 
ment to the client, the method comprising the steps 
of: 

retrieving the first document from the remote 
server in response to a request from the client, 
the document including data tor causing the cli- 
ent to generate a display; 
using the proxying server to alter the data in the 
first document to form a transcoded document; 
and 

transmitting the transcoded document to the 
client. 

2. A method according to claim 1 . wherein the step of 
using the proxying server to alter the data in the first 
document comprises the steps of: 

analyzing the data to determine whether a pre- 
determined condition is present in the data, 
wherein the predetermined condition com- 
prises data which, when used by the client, 
causes an error condition to occur; and 
if the predetermined condition is present in the 
data, revising the data to eliminate the prede- 
termined condition. 

3. A method according to claim 1 , wherein the step of 
transmitting the transcoded document to the client 
is performed prior to performing the step of using 
the proxying server to alter the data in the first doc- 
ument. 

4. A method according to claim 1 , wherein the client 
Includes a television display, wherein the document 
references an image, and wherein the step of using 
the proxying server to alter the data in the docu- 
ment comprises the step of revising the data such 
that the image is sized for display on the television 
display. 

6. A method according to claim 1, further comprising 
the steps of: 

retrieving an Image from the remote server In 
response to a request from the client, wherein 
the Image has a first Image format; and using 
the proxying server to convert the image from 
the first image format to a second image tor- 
mat. 

6. A method according to claim 1 , wherein the first 
document includes a link to a second document, 
the link including a first address, and wherein the 
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step of using the proxying saiver to alter the data In 
the document comprises the step of updating the 
link. 

7. A method according to claim 6, wherein the second s 
document is an image, and wherein the step of 
updating the link Includes the step of adding Infor- 
mation to the first document indicating the size of 
the image. 

10 

6. A method according to claim 6, wherein the second 
document is inaccessible to the proxying server, 
and wherein the step of updating the link comprises 
the step of removing the link. 

15 

9. A melhod according to claim 6, wherein the second 
document has been relocated from the first address 
to a redirect address, and wherein the step of 
updating the link comprises tie step of updating the 
link to correspond to the redirect address. so 

10. A method according to claim 1, further comprising 
the steps of: 

identifying an image referenced by the docu- 25 
merit; 

determining whether the image has been previ- 
ously retrieved by the proxying server; and 
H the Image has been previously retrieved by 
the proxying server, accessing information 30 
stored in the proxying server Indicating the size 
of the image; 

wherein the step of using the proxying server to 
alter the data in the document comprises the step ss 
of using the information indicating the size of the 
image to revise the data of the document to allow 
the document to be displayed by the client before 
the image is received by the client. 

40 

11. In a server coupled to a client and to a remote 
server, a method of providing proxy services to the 
client for accessing a document stored In the 
remote server, the document including data to be 
used by the client to provide a display, the method & 
comprising the steps of: 

providing a persistent database in the server, 
the persistent database including information 
relating to the document; and so 
using the information stored in the persistent 
database to guide the proxying services. 

12. A melhod according to daim 1 1 , further comprising 
the step of transcoding the document based on the 55 
information stored in the persistent database to 
generate a transcoded document. 

13. A melhod according to claim 12, further comprising 
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the step of providing the transcoded document to 
the client, wherein the step of providing the trans- 
coded document to the client Is performed prior to 
performing the step of transcoding. 

14. A method according to claim 12, wherein the per- 
sistent database Includes Information correspond- 
ing to a plurality of error conditions, the method 
further comprising the steps of: 

analyzing the data in the document using the 
information stored in the persistent database to 
determine whether the data is likely to cause 
one of the error conditions to occur when used 
by the client; and 

automatically revising the data If the data Is 
determined in the analyzing step to be likely to 
cause one of the error conditions to occur when 
used by the client 

15. A method according to claim 1 1 , further comprising 
the step of storing in the persistent database valid- 
ity information corresponding to the document 

16. A method according to claim 15, wherein the valid- 
ity Information Is based on an observed rate of 
change of the document. 

17. A method according to claim 1 1 , further comprising 
the step of Storing in the persistent database per- 
formance Information relating to performance of the 
remote server when accessing the document. 

18. A method according to claim 17 wherein the per- 
formance information is a latency value, 

19. A method according to claim 1 1 , further comprising 
the step of storing In the persistent database Infor- 
mation for optimizing memory usage by the client. 

20. In server coupled to a client, the client having an 
authorized user, wherein the server is for providing 
the client with a plurality of on-line services includ- 
ing a log-in service and a second service, the 
server including a user database, a method of con- 
trolling access by the client to the plurality of on-line 
services, the method comprising the steps of: 

storing in the database a set of user data corre- 
sponding to the authorized user; 
using the log-In service to receive a first access 
request from the client, the first access request 
for initiating access to the server by the client; 
generating an information packet from the set 
of user data, the Information packet Indicating 
access privileges of the authorized user in rela- 
tion to the plurality ol on-line services; 
using the log-in service to provide the informa- 
tion packet to the client; 
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using the second service to receive a second 
access request from the client, the second 
access request for requesting use of the sec- 
ond service by the client, the second access 
request including a copy of the information § 
packet; and 

using the copy of the Information packet to reg- 
ulate access by the client to the second serv- 
ice. 

w 

21 . A method according to claim 20, wherein the plural- 
ity of on-line services are Internet services. 

22. A method according to claim 20, wherein the sec- 
ond service is a proxy service by which the server is 
functions as a proxy on behaH of tha client for pur- 
poses of accessing a second server. 

2& in server system coupled to a client, a method of 
providing the client with a plurality of redundant » 
services, each of the redundant services being sub- 
stantially equivalent to each of the other redundant 
services, the method comprising the steps of: 

providing the client with a service name appli- 
cable to all of the redundant services; 
providing the client with a unique port number 
lor each sarvlca; 

providing the client with a unique protocol for 
each service; 

receiving a request to access one of the redun- 
dant services from the client the request 
including an address specifying the service 
name; and 

granting access to one of the redundant serv- 
ices in accordance with the name included in 
the address, one of the port numbers and one 
of the protocols, such that the client uses the 
same address to access any of the redundant 
services. 

24. A method according to claim 1, wherein the 
address is a URL (Uniform Resource Locator) 
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